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Abstract: We study the nonparametric estimators of the infinitesimal coefficients of the second-order 
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1 Introduction 
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t Nonstationary time series play an important role in economics and finance. Many statisticians have studied 
, the asymptotic properties on nonstationary time series model such as the integrated time series. The in- 
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tegrated stochastic processes would explain some modern econometric phenomena better since the current 
observation usually behaves as the cumulation of all past perturbation. Especially, when testing unit roots, 
if null hypothesis holds, we have 



Y t = Y + J2Xk, (1.1) 



5— i ' where = a + e^, {e^ : k = 0, 1, 2, • ■ •} is a sequence of i.i.d random variables. Obviously, the sequence 
{Yt;t = 0,1,2, ■■■} is not stationary. One common method to deal with the nonstationary time series is to 
use a differenced model (e.g. AYt = Xt). The difference transformation is practical in research. This model 
can be utilized in modern econometric analysis such as logarithmic stock price random walk and annual 
capital GDP. For further motivation and study on asymptotic properties, see Park and Phillips (2001). 

Recently, some authors have studied the continuous case of model (1.1) since many financial models are 
continuous-time. Naturally, model (1.1) can be extended to 

Y t = Y + f X s ds. (1.2) 
J o 

The differenced-data model of (1.2) is dYt = Xfdt. Considering stock price index at some time, X s represents 
stock price index; Yt indicates the cumulation of stock price index. In model (1.2), X s is usually assumed 
as a stationary continuous-time process such as diffusion process. The model accommodates nonstationary 
integrated stochastic processes that can be made stationary by differencing. 



"This research is supported 

' Corresponding author, songyuping2011@gmail.com 



Many popular models in financial time series involve continuous-time diffusion processes as solutions to 
stochastic differential equations below, such as option prices, interest rates, exchange rates and inter alia, 
see Baxter and Rennie (1996). A diffusion process X t is represented by the following stochastic differential 
equation: 

dX t = fjt(X t )dt + a{X t )dW u (1.3) 

where Wt is a standard Brownian motion, [/,(■) and cr(-) are the infinitesimal conditional drift and variation 
respectively. Based on the discret-time observations {XiA n ;i = 1,2, ■ ■ •}, some authors have studied the 
statistical inference for the coefficients, e.g., Bandi and Phillips (2003), Fan and Zhang (2003) and Xu 
(2009, 2010). 

However, all sample functions of a diffusion process driven by a Brownian motion are of unbounded vari- 
ation and nowhere differ entiable. So it is difficult to model integrated and differentiated diffusion processes 
which are useful in empirical finance. According to (1.2) and (1.3), Nicolau (2007) discussed a second-order 
diffusion process satisfying the following second-order stochastic differential equation: 

J dY * = X ^ a 4) 

\ dX t = n(X t )dt + a(X t )dW t , 

where Wt is a standard Brownian motion and X t is (by hypothesis) a stationary process. We observe that 
the model (1.4) can be written as a second-order stochastic differential equation: d(dY t /dt) = fi(X t )dt + 
a(X t )dWt- The second-order diffusion process overcomes the difficulties associated with the nondifferentia- 
bility of a Brownian motion. 

For model (1.4), the estimators for fj,(x) and a 2 (x) have been considered based on discrete-time observa- 
tions. Nicolau (2007) considered the Nadaraya- Watson estimators for fi(x) and <r 2 (x); Wang and Lin (2011) 
presented local linear estimators for these unknown quantities, Wang; Zhang and Wang (2011) studied the 
empirical likelihood inference for them. 

In fact, in many economic models the path of X t is not continuous, so besides / u(x),cr 2 (x) we need 
some coefficients to characterize the jump, for example, jump measure, intensity measure and conditional 
impact of a jump. Compared with estimators for model (1.4), we should estimate various coefficients such as 
fi(x),a(x) and c(x,z) for the following second-order jump-diffusion model based on discrete high-frequent 
observations, that is, considering the model 

f dY t = X t dt, 

\ dX t = n{X t -)dt + a(X t _)dW t + f f c(X t -,z)r(w,dt,dz), 

where £ = M. \ {0},Wt is a Wiener process, r(uj,dt,dz) = (p — q)(dt,dz), p(dt,dz) is a time-homogeneous 
Poisson random measure on R + x R independent of Wt, and q(dt,dz) is its intensity measure, that is, 
E\p(dt,dz)] = q(dt,dz) = f(z)dzdt, f(z) is a Levy density. 

Recently, many literature have been involved in the research on the following popular jump-diffusion 
model: 

dX t = ii(Xt-)dt + a(Xt-)dWt+ f c(X t -,z)r(u,dt,dz), (1.6) 

Jg 

in the sense that this model can accommodate impact of sudden and large shocks to financial markets, 
such as macroeconomic announcements and a dramatic interest rate cut by the Federal Reserve, see Bakshi 
(1997), Duffie (2000), Eraker, Johannes and Poison (2003) Johannes (2004). 
The statistical inferences for the coefficients of the model are based on the following relations: 

\\^E[ Xt ^~ Xt \X t = x} = n{x), (1.7) 
A^0 L\ 



lim E r( X »±- X t 
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X t = x] = a 2 (x) + J c(x,z)f(z)dz. (1.8) 



A^o A 

Based on these infinitesimal moments of the jump-diffusion model and discrete-time observations {^Qa„ ; i = 
1, 2, • • •}, many literature have been involved in this field to estimate the coefficients from different aspects, 
see Bandi and Nguyen (2003), Lin and Wang (2010). Mancini (2004, 2009) with Reno (2010) introduced 
threshold estimation for the coefficients of the model (1.6). Parametric estimations of the coefficients for the 
model (1.6) have been presented by Shimizu (2006). 

Similarly, we should consider model (1.5) to overcome the nondifferentiability of a Brownian motion and 
to model integrated and differentiated jump-diffusion processes for stock prices, compounded return or log 
return of an asset. Estimation of the coefficients in model (1.5) gives rise to new challenges for two main 
reasons. On the one hand, different from model (1.3) or model (1.6), although we usually get observations 
{YiA n ] i = 1) 2, • • •}, which are the cumulation of all the past perturbations, we cannot obtain the value of 
X at time ij from =Yq + X s ds in a fixed sample intervals. In addition, estimation of the coefficients 
cannot in principle be based on the observations {YiA n ;i = 1,2,- • •} because conditional distribution of 
Y is generally unknown even if that of X is known. On the other hand, for model (1.5) whether we have 
the similar relations as (1.7) and (1.8) which are the basic ones to establish Nadaraya- Watson estimators? 
Fortunately these are settled satisfactorily. 

We usually obtain discrete-time observations {Yi An ;i = 1,2,- • •} rather than {XiA n ;i = 1,2,- • •} for 
model (1.5). As Nicolau (2007) showed, with discrete-time observations {Yi An ;i = 1,2,- • •} and given that 

riA n r(i-l)A n riA n 

YiA n - Y(i-i)A n = / X u du - / X u du = / X u du, 

JO JO J(i- 



'(i-l)A n 



we can get an approximation value of X at instant tj = iA n by 



y _ YiAn Y (i-l)A n , X 

'An 

which is close to the value of X at t = iA n or t = (i — 1) A n with A n tends to zero. Our estimation procedures 
should be based on the samples {Xi& n ; i = 0, 1, 2, • • •}. 

We can also build the similar relations for model (1.5) as (1.7) and (1.8) seen in Remark 3.1, that is 

£[ X(m)A : " ^ I^-DaJ = M^-i)aJ + O p (A n ), (1.10) 
E[ (X(i + i)A^- X iAn ) 2 ^ ( ,_ i)aJ = * a 2 {X{i _ 1)An ) + I jf c?(X {i _ 1)An ,z)f(z)dz + O p (A n ). (1.11) 

where &t = cr{X s , s < t}. Based on these relations and (1.9), we can establish Nadaraya- Watson estimators 
for fx(x) and a 2 (x) + c 2 (x, z)f(z)dz, and further, under appropriate conditions we verify the consistency 
and asymptotic normality for these proposed estimators. 

The remainder of this paper is organized as follows. In Section 2, ordinary assumptions and N-W es- 
timators for model (1.5) are introduced. In Section 3, we present some useful preliminary results. In this 
section, consistency and asymptotic normality of the estimators in our paper are given. The proofs will be 
collected in Section 4. We give the brief calculation for the main equations (3.3) and (3.4) in Appendix. 



2 Nadaraya- Watson Estimators and Assumptions 

We briefly discuss the Nadaraya- Watson estimators for the coefficients in model (1.5) based on {XiA n ;i = 
0, 1, 2, ■ ■ •}. We firstly construct Nadaraya- Watson estimators for them based on equations (1.10) and (1.11) . 
The Nadaraya- Watson estimators for [i(x) and M(x) = a 2 (x) + j g c(x, z)f(z)dz are solutions to the following 
optimal problem: 

argmmE i=1 ( fi(x)\ K[ I, (2.1) 

fi{x) \ A n / \ n n j 

■ v n /|(^(i+l)A„ - X iAn ) 2 \ 2 /X - X(j_i)A„\ , . 

ar g mm V-_i — Mix)) K p — . (2.2) 

The solutions to (2.1) and (2.2) are 

an{x) = Mx) ' K{x) = Mx) (2 - 3) 

where A n (x) = ^ ^ g(f=%^) , B n (x) = ^ 5-^(^1%^) IfeaglW 

Pn(x) = iELl^(^ Z %^)- 

The paper is devoted to study the following estimators p n (x),a n (x),b n (x) for p(x), /i(x) and a 2 (x) + 
fgC 2 (x, z)f(z)dz respectively, where p(x) be the stationary probability measure for X t . There are some 
differences between the estimators given in this paper for model (1.6) and the ones in Bandi and Nguyen 
(2003). Take the estimator for fi(x) as an example. In Bandi and Nguyen (2003), if the observations are 
based on {Xi A „;i = 0,1,2,- • •}, the Nadaraya- Watson estimator for fi(x) should be a n {x) = ^Nfj where 

A' n (x) = ^ E? = i K(^K^-) ( ^-fr i)Aj . We easily see that fel^Z^J and 
in A n (x) and A n (x) are different. The model considered in this article is more complex than the one in Bandi 
and Nguyen (2003). The consistence and asymptotic normality of the estimators may be not obtained by 
the method exploited for stationary case in Bandi and Nguyen (2003), but we can get them by means of the 
method introduced by Nicolau (2007). This is due to the sense that we need to compute some meaningful 
conditional expect values of the estimator in the proof which may be not obtained if A n (x) is the same as 
A' n (x). In addition, there are some contacts between the estimators here and in Bandi and Nguyen (2003). 
XiA n and Xu_]\A n are close to the value of -XVj_i)A„> which intuitively to a certain extent guarantees 
the desired result in the article reasonably from the result in Bandi and Nguyen (2003) (rigorous proof 
theoretically seen in the following Lemmas and Theorems). 

We now present some assumptions used in the paper. In what follows, let S 1 = {l,u) with I > —00 and 
u < 00 denote the admissible range of the process X t . 

Assumption 1. 

(i) (Local Lipschitz continuity) For each n G N, there exist a constant L n and a function ( n : $ — > M + 
with J ( gC, 2 {z)f{z)dz < 00 such that, for any \x\ < n, \y\ < n, 

\n(x) - n(y)\ + \a(x) - a(y)\ < L n \x - y\, \c(x, z) - c(y, z)\ < Q n {z)\x - y\. 

(ii) (Linear growthness) For each n G N, there is ( n as above, such that for all x£l, 

\c(x,z)\ < C n (z)(l + \x\). 



Remark 2.1. Assumption 1 guarantees the existence and uniqueness of a solution to Xt in Eq.(1.5) on 
the probability space (fi, P), see Jacod and Shiryayev (1987). 



Assumption 2. The process X t is ergodic and stationary with a finite invariant measure (f>{x). 

Remark 2.2. The finite invariant measure implies that the process Xt is positive Harris recurrent with 
the stationary probability measure p(x) = -jjjnbi Vx £ Q>. The hypothesis that Xt is a stationary process 
is obviously a plausible assumption because for major integrated time series data, a simple differentiation 
generally assures stationarity. 

Assumption 3. The process Xt is p— mixing with Y2i>i p{^n) < °°- 

Remark 2.3. We notice that the process {Xi/± n ]i = 1,2, • • •} is stationary and p— mixing with the 
same mixing size. Similarly as Ditlevsen and S0rensen (2004) pointed out, by stationarity, the law of the 
process Xt is invariant under time translations, which easily implies that {Xi& n ; i = 1, 2, • • •} is a stationary 
process. Since the cr-algebra generated by {XiA n , i = 1, ■ ■ -,n} is contained in the cr-algebra generated by 
{X u ,0 < u < nA n }, and the cr-algebra generated by {XiA n ,i = n + 1, ■ ■ ■} is contained in the cr-algebra 
generated by {X u ,u > nA n }, the process Xi& n is p— mixing with the the same mixing size. For instance, the 
p— mixing process X t with exponentially decreasing mixing coefficients satisfies the condition, see Hansen 
and Scheinkman (1995), Chen, Hansen and Carrasco (2010). 

Assumption 4. The kernel K(-) : R — > R + is a positive, symmetric and continuously differentiable 
function satisfying f K{u)du = 1,/ uK(u) = and := / K 2 {u)du < 00. 

Assumption 5. For any 2 < i < n, lim/ l _ >0 -E'[ \ |^'(Cn,i)| a ] < 00 where a = 2, 4 or 8 and = 

o{ x ~\ 1)An ) + (1 - e){ x ~ X(t h 1)An ), o<e<i. 

Remark 2.4. As Nicolau (2007) pointed out this assumption is generally satisfied under very weak 
conditions. For instance, with a Gaussian kernel and a Cauchy stationary density (which has heavy tails) 
we still have lim^ -^[(^)l-^'(x)! 8 ] < 00 • Notice that the expectation with respect to the distribution £ n> j 
depends on the stationary densities of X and X because £ raj j is a convex linear combination of X and X. 

Assumption 6. For all p > 1, sup t>0 -E[|X t | p ] < 00, and j g \z\ p f(z)dz < 00. 

Remark 2.5. This assumption guarantees that Lemma 3.1 can be used properly throughout the article. 
If Xt is a Levy process with bounded jumps (i.e., sup t |AXt| < C < 00 almost surely, where C is a nonrandom 
constant), then < 00 Vn, that is, Xt has bounded moments of all orders. This condition is widely 

used in the estimation of an ergodic diffusion or jump-diffusion from discrete observations, see Florens- 
Zmirou (1989), Kessler (1997), Shimizu and Yoshida (2006). 

— A 1 

Assumption 7. A n -)• 0, h n = AA 1 , ( n ^)(A n log(^-)) 2 0, h n nA n -> 00, as n ->• 00. 

3 Some Technical Lemmas and Asymptotic Results 

We lay out some notations. For x = (xi, x d ), d Xj := d% := J^, d%. x := dx f dx , , dx := (d xi ,---, dx d )*, 

and d x f(x) = \pxiXj)\<i j< d -> w bere * stands for the transpose. 

Lemma 3.1. (Yasutaka Shimizu, 2006) Let Z be a ci-dimensional solution-process to the stochastic 
differential equation 

Z t = Z + [ fi{Z s ^)ds+ [ a{Z s ^)dW s + [ [ c(Z s _,z)r{Lu,dt,dz), 
Jo Jo JO Js 

where Zq is a random variable, $ = M d \ {0}, p(x), c(x, z) are ci-dimensional vectors defined on R d ,R d x $ 
respectively, a(x) is a d x d diagnonal matrix defined on R d , and Wt is a ci-dimensional vector of independent 



Brownian motions. Let g be a C 2 ^ +1 )-class function whose derivatives up to 2(1 + l)th are of polynomial 
growth. Assume that the coefficient /j,(x),a(x), and c(x, z) are C 2 '-class function whose derivatives with 
respective to x up to 2Zth are of polynomial growth. Under Assumption 6, the following expansion holds 



A j 



E[g(Z t )m = ^Vg(Z s )^ + R, (3.1) 

3=0 J ' 

for t > s and A n = t—s, where R = J n Jq 1 . . . J^ 1 E[L l+1 g(Z s+Ul+1 )\^ s }dui . . . dui + \ is a stochastic function 
of order A l + 1 ,Lg(x) = d*g(x)n(x) + \tr[dlg{x)a(x)a* (x)] + f#{g(x + c(x, z)) - g{x) - d*g(x)c(x, z)}f(z)dz. 

Remark 3.1. Consider a particularly important model: 

f dY t = X t dt, 

\ dX t = fi{X t -)dt + a(X t _)dW t + f, c(X t _,z)r(w, dt, dz). 



As d = 2, we have 

T .nl m 1 1 1 — T* \ r\n I r^i i 1 _1_ //I <r* \ ( r)n / r)ir>\ _|_ 

(3-2) 



Lg(x,y) = x(dg/dy) + /j,(x)(dg/dx) + \a 2 (x)(d 2 g / dx 2 ) 



Based on the second-order differential operator (3.2), we can calculate many mathematical expectations 
involving Xi An , for instance (see Appendix for details): 

£[ X(m)A : " ^ l^-i)A n ] = M^-i)aJ + Op(A„), (3.3) 

E[ (^ + i)A^- ^aJ 2 |^ ( ._ i)a j = ^( X( ,_ 1)A J + lj^(X {i _ 1)An ,z)f(z)dz + O p (A„). (3.4) 
In fact, the above equations provide the basis for estimators (2.2) and (2.3). 

Lemma 3.2. (Bandi and Nguyen, 2003) Assume that Assumptions 1, 2, 4, 6, 7 hold, let 



where 



x - X (i _ 1)An \ (X iAn - Xu_ 1)A J 



4m = £e*F^) 

i=i 

B°(x) = ^-YK( X - X( - 1)A " ) (XlA " ~ ^ . 
nV nh n ^ V /i n 7 A n 



We have 



Pn( x ) -^P(^), al{x) A- n(x), b1(x)^a 2 (x)+ c 2 (x,z)f(z)dz, 

Jg 

i : — . a, , , ss d ( CJ 2 (x)+ fj,C 2 (x,z)f(z)dz\ 

y/h^l(a n (x) - (iix)) A N(0,K 2 V > J * ^ m 1 j, 
VK^M (s) - (a 2 (x) + J c 2 (x, z)f(z)dz)) A N(0, k J'*^®** ) . 



Lemma 3.3. Assumptions 1-3 and 5-7 lead to the following results, 
W nh„ 2-,i=l ^ ^ fc„ J nh n l^i=l h n J ~^ U ' 

/■■n _J_ v^n ^ ^-^(.-liA^ (^(,+l)A n -^»A n ) _J_ Tr f x-X (i _ 1)An \ (X (i+1)An -X iAn ) 

\ U ) nh n 2-,i=l \ h n J An nh n ^i = l V hn J An ~^ U ' 

(AAA\ _J_ 7>^ ( x - y i»-l)A„ ^ |(^(i+l)A n -^iA n ) 2 ]_ v^rt 7^/ a ~ X (i-l)A ra ^ f (^(i+l) A n -^»A n ) 2 V n 

l'"; „ft n Z^i=l ^\ hn j An nhn ^»=1 ^ ^ J A n U ' 

Theorem 3.1. If Assumptions 1-7 hold, then 



: = ^ E K { — j- — J *>(*)■ 



Theorem 3.2. 

(i) Under the Assumptions 1 - 7, we have 



(ii) Under the Assumptions 1-7 and /i„nA^ — > 0, we have 

/ / , , , ,\ rf / a 2 (x) + faC 2 (x,z)f(z)dz\ 

^h~^ n (a n {x) - n(x)) A N(0, K 2 y ' Js V ;J 1 ; j . 



Theorem 3.3. 

(i) Under the Assumptions 1 - 7, we have 



k(x) = A * 2 (*) + / c\x,z)f(z)dz. 

Pn{X) Js 

(ii) Under the assumptions 1-7 and h n nA^ — > 0, we have 

Vh n nA n (b n (x) - (a 2 (x) + c 2 (x, z)f{z)dzj) A n(o, K- z 



fgc 4 (x,z)f(z)dz 

2 



Remark 3.2. Contrary to the second-order diffusion model without jumps (Joao Nicolau, 2007), the 
second infinitesimal moment estimator has a rate of convergence that is the same as the rate of convergence 
of the first infinitesimal moment estimator. Apparently, this is due to the presence of discontinuous breaks 
that have an equal impact on all the functional estimates. 

4 Proofs. 

Proof of Lemma 3.3. 

Let ei>B = p n (x) - p n (x) = ^ 5-1 ^(^%^) " db 5Xi *( f =% a * t ) . 
By the mean-value theorem, stationarity and Holder's inequality, we obtain: 

E[\e,, n \] < E[^U\K\t n /^- X ^« 



Tih n h n 



< [e[^k'\^ 2 )])\e[^- x ^ )2 ^ 



hi 



where £„, 2 = O(^j^) + (1 - 0)(?=%±) < 9 < 1. 
Using Lemma 3.1 with d = 2, we get 

-(^-XaJ 2 , A„ 



|j (E[a\X )] + C 2 (A , z)/(z)dz] + 0(A n )) -> 



from Assumptions 5-7, thus i2[|£i j7l |] — > . Lemma 3.3 (i) follows from Chebyshev's inequality. 
Now we prove (ii), write 



1 

E2,n = A n ( X ) - A° n ( X ) = —^ K ( 

i=l 



a: - x (i-i)A n \ ( x (i+i)A n ~ x iA r , 



n/i n ^ V /in / 



- -X"(i-1)A„ \ (-X"(i+l)A n - X;aJ 



We have 



nh r 



i=l 



x-X, 



(»-l)A„ 



/?,, 



i=l 



if 



x-X, 



(i-l)A„ 



/l T , 



A r 



X(i+i)A„ - X,a„ 



A, 



= E 



E 



x-X, 



(i-l)A„ 



1 s X An - X A 

Y K {in ' 2) 1 



h n J \ h n 
(//(X A J + O p (A n )) 



by (3.3), the mean- value theorem and stationarity. Hence 



E[e 2 , n ] 



< E 

< 



(f n , 2 )| lXA \ XaJ Hx An ) + O p (A n )\ 



- ( 



E[a\X )]+E[^c 2 (X ,z)f(z)dz} 



0(A n )W^) 
ft 4 



(e[^-K'\^ 2 )]) % (^[|^(X )| 4 ] + 0(A n )) % 0, 



'(i-l)A n J 



-i)A„) + Op(A„) 



^ (i5[tf' 4 (£ ni2 )]) 4 (^[|/x(X A J + O p (A n ) | 4 ]) 4 (^[(X An - XaJ 2 ]) ' 



by Holder inequality, Lemma 3.1 and Assumption 5. So E[e 2)Tl ] ~^ 0. 
Moreover 

! ,. - 1 ^ 1 



Var[£2 ' n] = ^ n Var[ ^ 1 7h = n K ' { ^ k 
=: ^ n Var[ ^ fl] - 



X (i-l)A n ~ X (i -l)A n /-^- X (i+l)A n ~ X iA n , 



We find Var[± Y%=i fi\ = \ Ya=i Var[fi] + where e n represents the sum of \ YTj=l J27=j+i terms 
involving the autovariances. Under Assumptions 2 and 3, the series is absolutely convergent, and one 
easily obtains Var[^ YJLi fi] < oo if E[f 2 } < oo. 

Using Lemma 3.1 with d = 2, simple but tedious calculations enable us to get 

m<Y Y \*\& ] _ A nj^c\X {i _ 2)An ,z)f(z)dz 
H\ X (i-l)A n - X(i-l)A n ) \^(i-2)A n \ ~ o h °( A n)- 



Now we calculate E[f t 



21. 



E[fl 



E 



= E 



}_ K l2 (t \ ( X (»-1)A„ ~ X (i-l)A n ) 2 { X {i+l) An ~ X iA n ) 2 

h {U,i> h 2 A 

1 ^ (f . x (£(j-l)An ~^(i-l)A n ) 2 /2 



a 2 (X (l _ 1)A J + O p (A n )) 



< ^ (^(Ml) 1 (E[(X (t - 1)An - ^-i)A„) 4 ]) * (^[(^ 2 (^-i)A J + O p (A„)) 4 ]) 



^^(^[£^' 8 (^)]) i (^k 8 (^i)Aj] + 0(A n )) f < oo 



by (3.4), Holder inequality and Assumptions 5 and 7. 

In conclusion, Uar[e 2 ri ] = wA ^ Uar[^ as n oo by Assumption 7. 

So Lemma 3.3 (ii) can be deduced from the above considerations. 

Finally, write 

e 3 , n - B n (x) - B n (x) - ^^K[ j — 



i=i 



1 

nh r 



i=i 



^(»-l)A n \ (^(i+l)A w ~ X iA„Y 



Lemma 3.3 (hi) now follows: 



h r , 



' x — Xi. 



-) 



( X (i+l)A n ~ X iA n ) 



A r , 



< CE[±-K\^ 2 ) lXA " hn XA J (^(X An ) + O p (A n )) 

< £ (e[k'\u,2)}) k (E[(X An - X An ) 2 ]) h (E[a 8 (X An )} + 0(A n )) 1 



= C ^(E[-K'\u,2)]Y(E[a 8 (X An )} + 0(A n )Y 0, 

"-n 

which implies Lemma 3.3 (iii). 

Proof of Theorem 3.1. One can easily prove Theorem 3.1 by Lemma 3.2 and Lemma 3.3 (i) 
Proof of Theorem 3.2. 

(i) From Theorem 3.1 we get p n (x) A p(x), hence to prove 



it is sufficient to verify that 



From Lemma 3.2. we obtain 



A n (x) 4 fi(x)p(x). 



A° n (x) A n(x)p(x). 

Now we prove A n (x) — A n {x) A 0. By Lemma 3.3 (ii) A n (x) — A n (x) has the same limit in probability as 



Si, n (x) 



1 K ( x ~ x (i-i)A n \ ( x (i+i)A n ~ x iA r 

nh n ~[ ^ K J A n 



1 k( — X(i ~ 1)An ) ( XiAn ~ X ('- 1 ) A " 

1=1 
1 n 

nh n ^ K ( 

i=i 



x (i-i)A n \ ( (X( i+ i)A n - x iAn ) {x iAn - X(j_ 1)An ; 



-)( 



■)■ 



We now prove that 5\ >n (x) A- 0. Using Assumptions 1, 2, 4, 6 and Lemma 3.1, we find 
■ }_ K ( X ~ X (i-l)A n \ ( { X (i+l)A n ~ X iA n ) ( X iA n ~ X (i-l)A n 

-Kn V 



E[6 1>n (x)] = E 



-)(■ 



A. 



E 



t \ — i r r a a ) J ^-i)An 



x — Xn 



(j-l)A, 



for, 



") (m(^(»-1)A„)M (^(i-l)A„) + 2°" 2 ( X (i-l)An)^ (%1)A„) 



+ / {K x (i-i)A n +c(X {i _ 1)An ,z)) - n{X {i _ 1)An ) - fi(X(i_ 1)An ) ■ c{X {i _ 1)An ,z)}f{z)dz^ 



2 
+ 



-K 



x — u 



n(u)n (u) + -a 2 (u)fi (u) 



{n(u + c(u, z)) — fi(u) — fi (u) • c(u, z)} f(z)dz S jp(u)di 



= 0(A n ) 



and 



Var[5i, n (x)\ 
1 



nA n h n 
1 

nA n h n 



Var 



Var 



1 1 k( x ~ Xu ~ 



(j-l)A, 



A /T-Z ^i+ljA;, ~ j^Aj (A iAn ~ -^(i-l)Aj \ 

V V H A„. A„ J 



We have Var[^Yli=i9i] = ^Yh=i v ar [9i] + £ n where e n represents the sum of | Z)^=i SILj+i terms 
involving the autovariances. Under Assumptions 2 and 3, the series is absolutely convergent, and one 
easily obtains Var[^ Y^i=i 9i\ < 00 if E[gf] < oo. In fact 



is finite because 



v K2 



x-X. 



(i-l)A„ 



A, 



( X (i+l)A n ~ X iAn ) {X iAn - X(j_ 1)An )\2 



A, 



)' 



A. 



f ( X (i+l)A n ~ X iA n ) _ (Xj An - X(i-i)A r . 



A r 



A n 



^E[a 2 (X )] + E[f c 2 (X ,z)f(z)dz])+O(A n ) 



by Lemma 3.1. In conclusion, Far[<5i ;n ] = nA h Var[-^ Yli=i ~ y ® as 71 ~ y 00 by Assumption 7. 
(ii) By Lemma 3.2, 



U° n {x) := Vh n nA n (a° n (x) - M (ar)) A n(o,K 2 



a 



''(x) + JgC 2 (x,z)f(z)dz^ 



p(x) 



and by the asymptotic equivalence theorem, it suffices to prove that 

U n (x) - U° n {x) A 

where U n {x) = \/h n nA n (a n (x) — (J>(x)). From part (i) we know that U n (x) — U®(x) = \J h n nA n ^ ^'"^ ^ and 
S p n (x) = O p (A n ). Thus the assumption h n nA^ — > leads to the result. 
Proof of Theorem 3.3. 

(i) From Theorem 3.1 we know p n (x) A p(x), hence to prove 

k(x) = ^\ A a 2 (x) + / c 2 (x,z)f(z)dz 

Pn{X) Jg 



it is sufficient to verify that 
Following Lemma 3.2 under the conditions of the theorem we obtain 



B n (x) A (a 2 (x) + I c 2 (x,z)f(z)dz)p(x). 

s 



B° n (x)A(a 2 (x)+ I c 2 (x,z)f(z)dz)p(x). 



So, we only need to prove that 



B n {x) - B° n (x) A 0. 



By Lemma 3.3 (hi) B n (x) — B®(x) has the same limit in probability as 

w.) =- -Lt^(^f^) i(i, - +i) r" ,Aj2 

i=l 

1 \^ R ( X ~ X (i-l)A n \ (XiA n ~ X {i _ l)An ) 2 

nh n f-' V h n ) A n 

1 S^ K ( X Z X ( i ^ 1 ) A n \ / |( X (»+1)A„ - X iA n ) 2 {XjA n ~ X {i _ 1)A J 2 \ 
We now prove that 5 2 , n (x) A 0. Let q t = ^ (X( ' +1) ^~ XiA " )2 - (X ' A "~f^ 1)Aj2 . By Lemma 3.1 



E 



r 3 



(^(i+l)A„ - -*QaJ 



'(i-l)A„ 



E 



(Xi An - -^(i-I)aJ 



'(i-l)A„ 



o- 2 (X(i-i)A n )+ [ c 2 (X ( ^ 1)An )f(z)dz + 0(A n ), 
o- 2 (X {i _ 1)An )+ [ c 2 (X (t _ 1)An )f(z)dz + 0(A n ). 



One has 



m = E w- 2 {x {i+l)A - x iAn ) _ (x lAn -x (t _ 1)An ) |i = o(A ^_ 

We easily verifies that E[52, n (%)] — > by stationarity and the above equations. 



On the other hand, 



Var[S 2 , n (x)] 
1 



nA n h n 



Var 



( X (i+l)A n - X iA n ) 2 {XiA n ~ X (i-l)A n ] 



A r 



-Var 



nA n h n L^/n^ 

Using the same arguments as in the proof of Theorem 3.2 (i), it is easy to conclude that the condition: 



E 



A 



-( 



|(^(i+l)A n - X iAn ) 2 (X iAn - X (i _ 1)A J 2 \ 2 



A n A n 

assures Var[52, n (x)] — >■ 0. 
(ii) By Lemma 3.2, 

C/°(x) := ^/h^A~(b° n (x) - (a 2 (x) + J^c 2 (x, z)f(z)dz)) A n(o,K 2 

and by the asymptotic equivalence theorem, it suffices to prove that 

U n (x) - U°{x) A 



) ] =0(1) 



f g c 4 {x,z)f(z)dz 
p(x) 



where U n (x) = y/h n nA n (b n (x) - (a 2 (x) + \ g c 2 (x, z)f(z)dz)). 
From part (i) we know that 



U n ( X ) - U° n { X ) = ^h^ni 5 ^) 



Pn(x) 



and 



Pn{x) 



= O p {A n ). 



Thus the assumption h n nA\ — > leads to the result. 



5 Appendix. 

In this part, we give some details for equations (3.3) and (3.4). 

H T l^(i-l)A n J - ^2 \&iA n \W(i-l)A n \- 

We firstly deal with the following part by equations (3.1) and (3.2): 

E[ (y ( , +1) A n -2Y^ n+ Y^ 1)A J ^ Aj = _^ {Y{t _ 1)An - Y iAn ) + £-X iAn + \n{X iAn ) + O p (A n ). 

By (3.1) and (5.2), (5.1) can be written as: 

£[4( y (i-l)A„-^iAjl^(i-^ 
We have: E[ ^ Y{l _ 1)An - Y iAn )\& {i _ 1)A J = -£-X (i _ 1)An - ±M*(i-i)A„) + O p (A n ), 

^[s^^iA n |^(j-l)A n ] = £^(j-l)A n +A t (^(i-l)A„) + Op( A n)- 

Finally we can deduce (3.3) by the above equations (5.1) - (5.5). 

For (3.4), we know the following equations by the tower property of conditional expectation: 



(5.1) 

(5.2) 

(5.3) 
(5.4) 
(5.5) 



^ { X (i+l)A n ~ X iA n ) ^^ { Y (i+l)A n ~ 2Y iA n + Y(i-l)A n ) , - , , > 
a l-^(i-l)A„] = X3 \^iA n W(i-l)A n \- (5.6) 

We deal with the inner part in (5.6) by equations (3.1) and (3.2): 

TP ^ ( Y (i+l)A n ~ 2YiA n + Y{i-l)A n f , - , 1 , s 2 2 

T3 = 73 (iiA„ ~ Y (i-l)A n ) + ^rj (^(i-lJA,, ~ ^A„JAj An 

+ 7^[^A„ + M^AjOVi)A n " ^Aj] 



A 

+ 



±[6X iAn v(X iA J + 2a 2 (X lAn ) + A^c 2 (X lAn ,z)f(z)dz} + O p (A, 



6 

:= Ai + A 2 + As + A 4 

For E[Ai\^ {i _ 1)An ), denote g(a;,y) = (y - Y^_ 1)An ) 2 , we have: 
Lg(x,y) = 2(y - Y (i _ 1)An )x, 
L 2 g(x, y) = 2x 2 + 2 f i(x)(y - Y {i _ 1)A J, 

L 3 g(x, y) = 2fi(x)x + M (ar)[4x + 2//(z)(y - Y {i _ 1)A J] + ±a 2 (:r)[4 + 2fi" (x)(y - Y {i _ 1)A J] 
+^{2(x+c(z,z)) 2 -2:e 2 +[2^+ C (x,^ 
By Lemma 3.1, we can obtain 

£[Ai|^ (i _ 1)A J = + Ml (l -i)A„)%-i)A„ + <j2(X( 3' 1)Aj + I X? c 2 (X ( ^ 1)An ,z)f(z)dz + O p (A„), 

By constructing functions g 2 {x,y) = (!(j-i)A„ - 93{x,y) = x 2 + j [x(x)(Y"( i _i) An - y), we can get: 

£L4 2 |^-i) A J = - - ^ -3Ml(i-l)AjI(,-l)A„-^(I (i -l)Aj-J^(%-l)A^)/(^)&+Q y (An), 
^[^3|^-i) A J = + X {i _ 1)Ant i(X {i _ 1)A J + a 2 (X (i _ 1)A J + X, c 2 (X (l _ 1)An , z)f(z)dz + O p (A n ). 

We easily have: 

E[A 4 \^ {i _ 1)A J = »(X {i _ 1)An )X {i _ 1)An + <t2(X( ' 3 1)aJ + | c 2 (X (i _ 1)An , z)f(z)dz + O p (A n ). 
Following the above calculation, we known (3.4) holds, that is: 

^[ ( ^ +1)A a;^ AJ V (,-i)aJ = F(X (l _ 1)A J + § /, c 2 (X { ^ 1)An ,z)f(z)dz + O p (A n ). 
Other equations calculated analogue with the above, we omit them here. 
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